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Abstract. In this paper, we show that for every constant < e < 
1/2 and for every constant d > 2, the minimum size of a depth d 
Boolean circuit that e-approximates Majority function on n variables 
is exp(6>(n 1/(2d - 2) )). The lower bound for every d > 2 and the upper 
bound for d = 2 have been previously shown by O'Donnell and Wimmer 
[ICALP'07], and the contribution of this paper is to give a matching 
upper bound for d > 3. 



1 Introduction and Results 

An investigation of the construction of small circuits for computing Ma- 
jority function in various computational models has attracted many re- 
searchers. Interesting positive results (e.g., for comparator networks [3] 
or for monotone formulae [7]) as well as some negative results (e.g., for 
constant depth circuits [3]) have been obtained so far. 

There also have been many researches on the construction of circuits 
to approximate the majority function. In this paper, we consider this 
problem in the model of constant depth circuits consisting of AND and 
OR gates with unbounded fan-in. 

It seems that there are two major notions of "approximate-Majority" 
in this model. The first meaning of "approximate-Majority" is to compute 
a function that coincides with the majority function on every points such 
that the fraction of l's in the inputs is at least 2/3, or is at most 1/3. 
The complexity of approximate-Majority of this notion is closely related 
to the complexity of probabilistic computations, and has been widely 
investigated (e.g., |l|2|8j .) 

The second meaning of "approximate-Majority", which we focus on 
in this paper, is to compute a function that disagrees with the majority 
function on at most e fraction of all points. We call such a function an 
e-approximation of the majority function. 

O'Donnell and Wimmer [6] first investigated this problem and ob- 
tained the following: (i) For every constant < e < 1/2 and every 



constant d > 2, any depth-d circuit computing an e-approximation of 
the majority function on n variables is ex.~p(f2(n 1 /( 2d ~ 2 ^)), and (ii) When 
d = 2, this lower bound is optimal up to a constant factor in the ex- 
ponent. The lower bound is proved by a combination of the argument 
based on the Hastad's switching lemma [5] (see also [1]) and the Kruskal- 
Katona Theorem developed in extremal set theory. The upper bound is 
proved by showing the existence of a DNF formula of size exp(0(^/n)) 
that e-approximates the majority function for every constant < e < 1/2. 

In this paper, we extend their results and show that their lower bound 
is in fact optimal (again, up to a constant factor in the exponent) for ev- 
ery constant d. Precisely, we give a probabilistic construction of depth d 
circuits of size exp(0(n 1// ( 2d_2 ^)) that e-approximates the majority func- 
tion, for every constant < e < 1/2 and for every constant d > 3. This 
is a main (and only) result of this paper. 

The proof is a simple generalization of the technique used in a beauti- 
ful construction of 0(n 5 ' 3 ) size monotone formulas for the majority func- 
tion by Valiant [7J. It should be noted that our circuit is monotone (i.e., 
without negated literals) and is formula (i.e., every gate has fan-out one). 

The organization of the paper is as follows. In Section 2, we give some 
notations and definitions. In Section 3, we describe the framework of our 
construction. The proof of the main result is described in Section 4. 

2 Notations and Definitions 

For a binary string x £ {0, l} ra , \x\ denotes the number of l's in x. The 
majority function on n variables, which is denoted by Maj n , is a Boolean 
function defined by Maj n (x) = 1 iff |x| > n/2. For < e < 1, a Boolean 
function / : {0, l} n — ► {0, 1} is said an e-approximation for Maj n if / and 
Maj n disagree on at most e fraction of all inputs, i.e., 

Pr[/(a;) + Maj n (x)] < e, 

X 

where the probability is over the uniform distribution on {0, l} n . For a 
set S, §S denotes the cardinality of S. 

We consider single-output circuits that consists of unbounded fan-in 
AND and OR gates over the input literals, i.e., input variables and their 
negations. The depth of a circuit is the number of gates in a longest path 
from the output to an input. The size of a circuit is the number of AND 
and OR gates in it. 

Throughout the paper, e denotes the base of the natural logarithm. 
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3 Random Circuits 



Let W = (wi, . . . , Wd) be a d-tuple of integers such that Wi > 2 for every 
1 < i < d. The values of W{ will be determined later. Define a sequence of 
random circuits f , fi, . . . , on X = {x\, . . . , x n } recursively as follows: 

1. fo is a Boolean variable chosen uniformly from X = {x±, . . . , x n }- 

2. For odd k, ffc is an AND of Wk independent copies of ffc-i- F° r even 
k, ffc is an OR of Wk independent copies of ffc-i- 

It is clear that id is a random circuit (in fact, formula) of depth d, 
where the bottom level consists of AND gates, and the fan-in of each gate 
at the fc-th level is Wk- The number of gates in is given by 1 + Wd + 

Wd-lWd H h ]lfc=2 W k < 2 Ilfc=2 w k- 

For k = 0, . . . , d and i £ {0, 1}, let A{(p) : [0, 1] -> [0, 1] be a function 
defined as follows: 

Aq(p) = p, for every p G [0, 1] 

A\{p) = {A\_ 1 {p)) Wk for every odd k, and for every p G [0, 1] 

Al(p) = (A® k _ 1 (p)) Wk for every even k with k > 2, and for every p G [0, 1] 

Ak(p) + ^.fc(p) = 1 ^ or ever y fc> an d for every p G [0, 1]. 

When fo gets one with probability p then ffc outputs i G {0, 1} with prob- 
ability A\{p). Note that A\{-) {A° k (-), resp.) is monotonically increasing 
(decreasing, resp). 

The following simple lemma relates the value of A|,(-)'s with the size 
of e-approximator circuits for the majority function. 

Lemma 1. Suppose that, for a given W = (w\, . . . , Wd), we have 
and 

Then there is a depth d circuit of size less than 2 Y\t=2 w k that computes 
a 3e- approximation for Maj n . 

Proof For every x G {0, l} n with \x\ < n/2 — ey/n, we have 
Pr[f d (x) + Maj n (x)] < A\ 
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since Eq. ([T]) and A d (-) is monotonically increasing. Similarly, for every 
x € {0, l} n with \x\ > n/2 + ey/n, we have 

Pr[f d (x) ^ Maj n (x)] < A° d 

Id 

since Eq. ([2]) and -A^(-) ^ s m onotonically decreasing. These immediately 
implies that there is a depth d circuit of size less than 2Y\^ =2 Wk whose 
output disagrees with the majority function on at most 

2 n 2 n 

e— + e— + %{x e {0, l} n | n/2 - ey 7 ^ < \x\ < n/2 + ey^} 

inputs. The last term is upper bounded by 

— fn\ _ 2 n 

2eM ,J <2e^-^ = 2e-2 n , 

where the first inequality follows from the Stirling formula. This completes 
the proof of the lemma. □ 

Note that, in this notation, a famous construction of 0(n 5 ' 3 ) size 
monotone formulae by Valiant [7] can be written as: A^(a(l/2 + 1/n)) < 
2~ n and A 1 d (a(l/2 - 1/n)) < 2~ n for W = (2, 2, . . . , 2) with d ~ 5.3 log 2 n 
and a = l)/2. 

4 Bounds for Approximating Majority 

In this section, we show our main theorem: 

Theorem 2. For every constant < e < 1/2 and for every constant 
d > 3, the majority function on n variables can be e- approximated by a 
depth d circuit of size 2°( nl/ 2d 2) ). This is optimal up to a constant factor 
in the exponent. 

By Lemma [H all we have to do is choose a suitable parameter W = 
(wi,... ,w d ) and verify that A° d (l/2 + e/ x/n) < e and A\{l/2-e/y/n) < e. 

We first give a proof for the case d = 3 as an illustrative example in 
Section 4.1, and then give a proof for general cases in Section 4.2. The 
proof for general cases includes also the case d = 3, and so a reader can 
skip Section 4.1 and go directly to Section 4.2. The key ingredient of the 
proof is Lemmas [3] and [4] in Section 4.2. 
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4.1 Construction of Depth Three Circuits 

We pick W = (wi,W2,w^) with w\ = ^n 1 / 4 , w 2 = 2 Wl w\, w 2 = (In 2)^2, 
= 2 Wl and 1V3 = (In 2)103. The number of gates in a circuit that will 
be constructed is less than 2w 2 w 3 = 2(ln2) 2 (2 Wl ) 2 u;i = 2°( nl/4 / £ ). 

Note that A{(l/2) = (1/2)™ 1 , A§(l/2) = (1 - (l/2) Wl ) W2 ~ (l/2) Wl 
and ^3(1/2) = (1 - (1/2)™ 1 )™ 3 ~ 1/2, which is a key property of our 
parameter. Put p^ := 1/2 + e/y/n and pi := 1/2 — ej\fn. Below we give 
a proof for A®(ph) < e and A\{pn) < e, which is a bit long but uses only 
elementary calculations. 

We first show that A®(ph) < By the definition, we have 

a° 2 (ph) = (i-pTT 2 = {{i - v7 f a2/p - 1) Y h 2 < (j) ■ (3) 

Here we use the inequality (1 — q) 1 ^ < 1/e for g < 1. The exponent in 
the last term of Eq. ([3]) is 

^*-Q + ^r*-*{(ir( i+ ^n 

Here we use the inequality (1 + g) r > 1 + qr for g > and r > 1. 

We proceed to the estimation of A®(ph). Since (1 — q) r > 1 — qr for 
g < 1 and r > 1, we have 

A3V) = 1 - (1 - ^C^))™ 3 < 1 - (1 - A°(^> 3 ) = A° 2 (p h )w 3 . (5) 
By plugging Eqs. © and (HJ) into Eq. ©, we have 

A°( P/l )<^(p^3<(ln2)^-j ^-J " Z"» 

2 

= (ln2) Q) £ <(ln2)|<e, 

where the second last inequality follows from (l/2) 2//e < e/2 which is 
equivalent to (1/2) < (e/2) e / 2 . This holds since the minimum value of the 
function g« is (l/e) 1 ^ ~ 0.6922 > (1/2). 
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We now turn to show A\{jpg) < e, in which we should bound the value 
of A® from below. 



A° 2 ( Pi ) = {i-pTT 2 = {(i -p^ 2 ^} 1 

n o\ w l ~ w l - 

>{(1-PD-} >\^-^\ • (6) 

We use (1 — > (1 — l/q)(l/e) for g > 1 to derive the first inequality, 
and use (1 — qf n2 > 1 — q to the second. The exponent in the last term is 

^ W2 = \2-^) ^=^{2) y 1 -^ 



2t 1 „ , 2 1 



We use (1 — < 1/e for g > 1 to derive the first inequality, and use 

(l/2) 2g < (l-q) for q < 1/2, which is equivalent to (1/4) < (l-q) 1 ^, to 
derive the last inequality. By plugging Eq. ([7]) into Eq. ([6]), we can show 
that, for every sufficiently large n, 



^(l-l/n 1 / 4 ) 



M(P) > [2) ■ (8) 

The proof of the above inequality is described in Appendix (Section 5.1). 

We now proceed to the estimation of A\{p£). Since (1 — q) r < (l/e) qr 
for q < 1 and r > 0, we have 



Ai(p e ) = (1 - A° 2 (p £ )r < Q 



2 



In order to show A\{pi) < e, it is sufficient to show that w^A^pe) > 
log 2 (l/e). By Eq. ([8]), we have 

/ \ wii(l-l/n 1 / 4 ) / -. \ -wii/n 1 / 4 

w 3 A° 2 ( Pe ) > 2"» i^-j = i^-j = 2V« > log 2 (l/e). 

This completes the proof of Theorem [2] for d = 3. 

1 Proof: (1 - = (1 - l/g)(l - 1/q)"' 1 = (1 - l/g)(l + l/(g - l))"^ 1 ) > 

(l-l/«)(l/e). 
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4.2 Construction for General Depths 

We pick W = (w\,W2, . . . , Wd) such that 

— Wl = (l/e)n 1 /(2d-2) ) 

— Wk = 2 Wl w\ and = (In 2){bk for k = 2, . . . , d — 1, 

— Wd = 2 Wl and = (hi2)u>d. 

As for the case d = 3, we choose parameters so that A} (1/2) = 
(l/2) wl ,i4§(l/2) = (1-(1/2) W1 ) 1U2 ~ (l/2) wl ,A£(l/2) = (l-(l/2) Wl ) w:i ~ 
(1/2) TO1 , and so on. 

The following two lemmas are almost all that we need. The proof of 
these two lemmas is described in Appendix (Sections 5.2 and 5.3). 

Lemma 3. Let w = (ln2)2 Wl u>i. Suppose that n is sufficiently large. 
Suppose also that 



fl\ Wl ( «- d \ 

A> f - J (l + cn 5 ^ T )J 



for some a G {2, . . . , d — 1} and some positive constant c. If a < d — 1, 
then 



, 1\ W1 ( c tg+ii-« 
(J -,!)""< (-) h-^nWiy 



If a = d — 1, then 



l\ Wl fl 

(i-Ar < 1 



Lemma 4. Let w = (\n.2)2 Wl w\. Suppose that n is sufficiently large. 
Suppose also that 



A < ( - J (l - cn 2 ( d -D J , 



for some a G {2, . . . , d — 1} and some positive constant c. If a < d — 1, 
then 



, l\ Wl ( c 
(1-A)»> - l + -nW 



If a = d — 1, then 



2e 



(i - > ■ ■ " ' 
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Proof of Theorem [2] Let W = (u>i, . . . , w^) be as described at the 
beginning of this subsection. The size of a circuit that will be constructed 
is less than 2l\ d k=2 w k = 2(ln2) d - 1 (2 wi ) d - 1 (wi) d ~ 2 = 2°(" 1/(2d " 2) A). p ut 
Ph := 1/2 + e/\/n and pi := 1/2 — e/^/n. Below, we will show that 
A° d (p h ) < e and A\( Pl ) < e. 

We first show that A^p^) < e. We start with 



l\ Wl / 2-d \ /iN^l 



> I - 1 (l + 2n^ T )J > 1-1 (l + n^DJ, (9) 

where the first inequality follows from the inequality (1 + q) r > 1 + qr for 
q > and r > 1. We use Lemma [3] to get 

A° 2 (p h ) = (1 - A}(p h )r < Q)" 1 (l - ^nW) ) . 

Then we use Lemma 0] to get 

A\( Ph ) = (i - A°(p,)r > Q)™ 1 (i + ^2"^) • 

By applying Lemmas [3] and H] alternatively, we have 

AUiPH) < (l) Wl (l - J^^) ( 10 ) 



when d is even, or we have 



when ci is odd. Note that when d = 3 we have already obtained Eq.(fTT 
as Eq.([9]). By applying Lemma [3] or 0] once again, we obtain 



A d-i(Ph) > 



l\ Wl ( 1 \ (l.le)(2e)<*-3 



2 / V 2 



^HD"^)" 2 *^"'-' ^ (12) 



when <i is even, and 
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when d is odd. The case for even d is finished by using Eq. (|12|) : 
A%p h ) = (1 - A\{ Ph )T* 

( Wln2)2™l /-, \ log 2 (l/e) 

tafcO/e)} <( 5 ) 

where the first inequality follows from the inequality (1 — g 1 ) 7 * < (l/e) 9r 
for q < 1 and r > 0. The case for odd d is finished by using Eq. (|13|) : 



4w4-G)~G) 



(10 2)2" 



> 1 - (ln2) ' > 1 - (ln2)e > 1 - e. 

Here we use the inequality (1 — q) r > 1 — qr for q < 1 and r > 1 to 
derive the first inequality, and use (l/2)^ 1 /' 3 ^ < q, which is equivalent to 
(1/2) < q q , to the second. This holds since the minimum value of the 
function q q is (l/e)^ ~ 0.6922. 

We now turn to show A\(pi) < e. The proof is almost analogous to 
the proof for A Q d (p h ) < e. The "base" is 



2-d 

^G)"( i "i^ n ^ j ) < G)"( i " n5Mj ) ! (14) 

where the first inequality follows from the inequality (1 — q) r < (l/e) qr 
for q < 1 and r > 0, and the second inequality follows from the inequality 
(l/2) 2q < 1 - q for q < 1/2, which is equivalent to (1/4) < (1 - q) 1/q . By 
applying Lemmas [3] and 2] alternatively, we have 

U'l 



when d is odd (note again that when d = 3, we have already obtained 
this as Eq.flTSJ)), or we have 
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when d is even. These inequalities are identical to Eqs. (|1U|) and if 
we swap ph and pi, "odd" and "even", and the role of and 1. This 
immediately implies the desired bound, i.e., A\{jpt) < e, since we have 
shown A° d (p h ) < e from Eqs. (HUD and ([IT]). □ 
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5 Appendix 

5.1 Proof of Eq. fl5|) 

What we want to show is 



This is equivalent to 



l-ln2 

w . 1\ (ln2)n 1 /4_ 1 

i-V>(-J • ( 15 ) 



Since l-q> (1/2) 2 "? for q < 1/2, we have 

1-01 -4tj I = 1 - - • , 1 ~] n A 2 > RHS of Eq. ma. 

\n 1 / 4 ) 2 (ln2)n 1 /4_l- " 

Since p™ 1 is exponentially small in n, i.e., p™ 1 = 0(l/2 nl/i ) = o(l/n 1 / 4 ), 
Eq. (|15j) holds for sufficiently large n. □ 
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5.2 Proof of Lemma [3] 

Since (1 — q) r < (l/e) qr for q < 1 and r > 0, we have 
(1 - A) w = (1 - A)^ 2Wlw ' < I ±J 



M)i(l+cn 2 ( d - 1 ) ) 

2 



a 

(g + l)-d 

1 \ ^1 / -| \ —71 2(3^1) 
1 \ / 1 N 



This completes the proof for a = d — 1. If a < d — 1 , then the exponent 
of the last term converges to as n — > oo. Hence, we use the inequality 
(1/2)9 < (1 - q /2) for q < 1, which is equivalent to (1/4) < (1 - g/2) 2 /<?, 
to show 

(1 - A) w < ( - j ( 1 ~ 2(d_1) ) ( for sufficiently large n), 
which completes the proof of the lemma. □ 



5.3 Proof of Lemma |4] 

By using the inequality (1 — l/q) g > (1 — l/q)(l/e) for q > 1 (whose proof 
is in the footnote in Section 4.1), we have 



(1 - A) w = (1 - Af a2 ^ lw ^ > 1(1 — A) | 



A-2 w iwi 



><(l-A) 



ii)i(l-cn 2 ( d - 1 ) ) 



> ( — J (for sufficiently large n) 



(a + l)-d 

1\ W1 fl\~~ r 



Wl , , , _^£_ n 2(d-l) 
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where the third inequality can be derived by a similar calculation as the 
proof of Eq. ([8]) in Section 5.1. This completes the proof for the case 
a = d — 1. When a < d — 1, the exponent of the last term converges to 
as n — * oo. Hence, we can use the inequality 2 q > (1 + (ln2)g) for q < 1, 
which is equivalent to e > (1 + q) 1 ^, to show 

/lA™ 1 f (hx2)c 1 

(i - ,4)™ > ( - J j i + n 2(d_1) f ( for surncientl y lar g e n ) 

> UJ Ye U 2(d ' 1} \ ■ 

This completes the proof of the lemma. □ 



12 



